Software Updating

ABSTRACT

A novel method for updating a bundle of files from an update package that minimize the free space requirement on disk is provided. The method segments the update of the entire package and performs the update in multiple passes. The method divide the archive payload of the entire update package into pieces and expand one piece of the archive in each pass. At the end of each pass, some embodiments remove from the disk the archive piece expanded in that pass in order to free additional space for the next pass.

CLAIM OF BENEFIT TO PRIOR APPLICATIONS

The present application claims the benefit of U.S. Provisional PatentApplication 62/235,457, filed Sep. 30, 2015. U.S. Provisional PatentApplications 62/235,457 is incorporated herein by reference.

BACKGROUND

The main obstacle for over the air (OTA) software updates is free spacerequirements. For each file to be modified during an OTA system update,one can either apply a patch that transforms an old version of the fileinto its corresponding new version, or by replacing the old version withthe new version from a compressed archive. For files whose new versionand old version differ little, updating a file by patching generallyrequires a smaller update file than by archiving.

The downside of patching is that it requires both the old version andthe new version to be present on disk at the same time. For very largefiles, such as the DYLD shared caches, having both old and new versionson the disk at the same time may require more free space than what isavailable on the disk, making update by patching impossible. One caneliminate the free-space requirement by archiving the new version of thefile, unfortunately doing so requires a very large update package, evenwhen the difference between the old version and the new version is verysmall. Typically, archiving the DYLD shared cache reduces free spacerequirement by 400 MB than by patching, but increases the update packagesize by 80 MB.

SUMMARY

Some embodiments of the invention provide a software updating methodthat divides a file into segments and updates the filesegment-by-segment. In some embodiments, a target file is divided intosegments, where some segments are updated by patching, while othersegments are updated by archiving. The segmentation of the update allowsvery large files such as DYLD shared caches to be patched in-place,i.e., by using free space available within the file to perform patchingrather than requiring enough free space on disk to store both the newversion and the old version of the file. The segmentation of the updatealso allows each segment to be updated individually by the most optimalupdate method (copy, patch, or archive) so that the size of the updatefile can be minimized. In some embodiments, the update file includes asegment map that specifies the size of each segment in the updated file,the update method of each segment (copy, patch, or archive), and theposition of the segment in the original file (if copy or patch).

In some embodiments, the in-place patching operations utilize theavailable free spaces within the file to move data around in ordercreate room for the new version of each patch or copy segment. In someembodiments, the new version of the patch or copy segment is constructedat its new position as specified by the segmentation map. During thisconstruction, as free space in the file is consumed to store the contentof the new version, the content of the old version is vacated to openadditional free space for subsequent update operations.

To facilitate the movement of data within the target file, someembodiments divide the file into a number of pages. To move data withinthe file, the updater in some embodiments moves the pages around thefile to create the necessary room. In order to track the movement ofthese pages, some embodiments employ a number of page-tracking tablesthat tracks the use and the position of each page.

Some embodiments invention provides a method for generating an updatepackage that segments the updating of a file. In some embodiments, themethod divides the file to be updated into segments, compares old andnew versions of each segment and determines whether the segment shouldbe updated by copying, patching, archiving. Some embodiments also checkswhether the generated update file allows the update to be performedin-place, i.e., having enough free space within the file during updateprocess. To do this check, some embodiments emulate the behavior of thecomputing device that receives the update package and performs thein-place updating to see if there would be enough free space within thetarget file. In some embodiments, if the update package generatordetermines that the target file would not have enough free space tocomplete updating in-place, it would change the update type/method ofsome of the segments from patch/copy to archive.

In some embodiments, such an update package is for updating a bundle offiles, e.g., for updating an entire operating system. Such an updatepackage can be very large, requiring a lot of storage space to downloadand store thus leaving very little free space on the disk to perform theactual update (e.g., storing old and new versions for patchingoperations, storing expanded archive data, etc.)

Some embodiments provide a method for updating a bundle of files from anupdate package that minimize the free space requirement on disk. Themethod segments the update of the entire package and performs the updatein multiple passes. Specifically, some embodiments divide the archivepayload of the entire update package into pieces and expand one piece ofthe archive in each pass. At the end of each pass, some embodimentsremove from the disk the archive piece expanded in that pass in order tofree additional space for the next pass.

In some embodiments, the update package is for updating the operatingsystem or an entire disk of a computing device. Such update packageincludes updates for the system partition and/or the user partition ofthe disk. The update operation in each pass resizes the system partitionin order to store system partition data expanded from the correspondingarchive piece of that pass. Some embodiments resize the system partitiongradually over the multiple passes rather than all at once in order toleave as much as space as possible for user partition during each pass.

The preceding Summary is intended to serve as a brief introduction tosome embodiments of the invention. It is not meant to be an introductionor overview of all inventive subject matter disclosed in this document.The Detailed Description that follows and the Drawings that are referredto in the Detailed Description will further describe the embodimentsdescribed in the Summary as well as other embodiments. Accordingly, tounderstand all the embodiments described by this document, a full reviewof the Summary, Detailed Description and the Drawings is needed.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features of the invention are set forth in the appendedclaims. However, for purpose of explanation, several embodiments of theinvention are set forth in the following figures.

FIG. 1 illustrates the updating of a file by segmented updatingaccording to some embodiments of the invention.

FIG. 2 illustrates the segmentation of a file during the segmentedupdating process.

FIG. 3 illustrates the segmented updating process when the new versionof the target file is larger than the old version.

FIGS. 4-5 illustrate page-based in-place/in-file updating operations.

FIG. 6 conceptually illustrates a process for performing in-place updateof a file.

FIG. 7 conceptually illustrates a process for performing patch/copyoperations for “P” and “C” segments.

FIG. 8 illustrates an update package generating system for generating anupdate package using segmented updating.

FIG. 9 conceptually illustrates a process for generating an update fileusing segmented updating.

FIG. 10 illustrates the update package generator checking for sufficientfree space for in-file updating.

FIG. 11 conceptually illustrates a process for ensuring that an updatefile or segmentation scheme would have sufficient free space to performin-place update/patching.

FIG. 12 illustrates an update package for updating a diskimage/operating system on a computing device.

FIG. 13 illustrates operations to free additional disk space beforeexpanding archive pieces.

FIG. 14 illustrates the expansion of archive pieces in multiple updatingpasses.

FIG. 15 illustrates the total disk usage throughout the multi-passarchive expansion process.

FIG. 16 conceptually illustrates a process for performing multi-passarchive expansion operations.

FIG. 17 conceptually illustrates an electronic system with which someembodiments of the invention are implemented.

DETAILED DESCRIPTION

In the following description, numerous details are set forth for thepurpose of explanation. However, one of ordinary skill in the art willrealize that the invention may be practiced without the use of thesespecific details. In other instances, well-known structures and devicesare shown in block diagram form in order not to obscure the descriptionof the invention with unnecessary detail.

Some embodiments of the invention provide a software updating methodthat divides a file into segments and updates the filesegment-by-segment. In some embodiments, a target file is divided intosegments, where some segments are updated by patching, while othersegments are updated by archiving. The segmentation of the update allowsvery large files such as DYLD shared caches to be patched in-place,i.e., by using free space available within the file to perform patchingrather than requiring enough free space on disk to store both the newversion and the old version of the file. The segmentation of the updatealso allows each segment to be updated individually by the most optimalupdate method (copy, patch, or archive) so that the size of the updatefile can be minimized. In some embodiments, segmenting the updatedallows DYLD shared cache to be updated without the 400 MB of free spacefor patching and without the 80 MBs increase in update file size forarchiving.

Several more detailed embodiments of the invention are described below.Section I further describes segmented update of a file. Section IIdescribes the generation of an update package by using segmented update.Section III describes a method for expanding an archive in multiplepasses in order to reduce requirement for free disk space. Section IVdescribes an electronic system with which some embodiments of theinvention are implemented.

I. Segmented Updating

For some embodiments of the invention, FIG. 1 illustrates the updatingof a file by segmented updating according to some embodiments of theinvention. The figure illustrates a computing device 100 receiving anupdate package 110 and using the received update package to update itsstored files 150.

The computing device 100 is illustrated as a mobile device receiving theupdate package 110 wirelessly or over the air. Such a computing devicecan be a smart phone, a tablet, a laptop, a desktop, or any computingdevice that is capable of receiving data wirelessly. Though notillustrated, the computing device 100 can also be an electronic devicethat is capable of receiving the update package over other mediums, suchas by wired cable (e.g., Ethernet) or by portable storage medium (e.g.,flash drives). The computing device 100 receives and stores the updatepackage 110. The information in the received update package 110 is thenused by an updater 105 executing in the computing device 100 to updatethe files 150 of the computing device 100.

The update package 110 includes several sets of update information forseveral files in the electronic device 100, including a set of updateinformation 115 (“file n update”) for updating one particular file 155(“file n”). This file being updated is also referred to as the targetfile as it is the target of the update. In some embodiments, the updatepackage 110 is for updating files of an operating system running on thecomputing device 100, and the particular file 155 being updated is avery large library file such as the DYLD shared cache for updating iOS®or OS X®.

The updater 105 of the computing device 100 takes the set of updateinformation 115 and updates the corresponding target file 155. The setof update information 115 for updating the file 155 (file n) is alsoreferred to as the update file for the target file 155. The set ofupdate information 115 (or update file 115) segments the target file 155into segments or sections that are to be updated by one copying,patching, or archiving.

The update file 115 includes a segment map 125, patch payload 135, andarchive payload 145. The segment map 125 designates each segment as“copy”, “patch”, or “archive”. The updater 105 in turn uses the patchdata in the patch payload 135 to update segments that are designated as“patch” segments and use the compressed data in the archive payload 145to update segments that are designed as “archive” segments. Segmentsupdated by archiving have their content replaced entirely by compresseddata in the archive payload 145. Update by archive is therefore alsoreferred to as a full-update. Segments updated by patching usesdifferential data in the patch payload 135 to construct updated/newversion of the segment from the original/old version of the segment.Segments updated by copying use the data of the old version of thesegment as the data of the new version. Some embodiments thereforetreats copy segments as patch segments without differential data.

In some embodiments, a segment map (e.g., 125) includes multipleentries, each entry correspond to a segment of the file to be updated.Each entry in some embodiments specifies the size of the segment in theupdated file and/or the size of the segment in the original file, thetype of segment (copy/patch/archive), and the position of the segment inthe original file (if copy or patch). Some embodiments also specify anoffset of the segment and a size of the segment's payload.

As mentioned, the file 155 is updated segment by segment. The figureillustrates the file 155 during the updating process, some segments arealready updated (updated segments 162) to their corresponding newversion, and some segments are not yet updated (not-yet-updated segments164) and still have the old version. The updater 105 is updating asegment 166 by utilizing the free space 160 that is available in thefile to store both the new and old versions of he segment. In someembodiments, this free space in the file 155 comes from segments thathave been vacated.

The segmentation of the update file 115 therefore allows the updating ofthe file 155 to be performed “in-place”, i.e., by using only the spacealready allocated to the file 155 to perform patching. This patching isdone on a segment-by-segment basis, which requires only enough space tokeep new and old version of the segment being updated (166) rather thanthe bulk of space needed to keep both the new and old version of theentire file 155.

FIG. 2 illustrates the segmentation of a file during the segmentedupdating process. The segmentation allows free space to be found withinthe file 155, which allows the file 155 to be patched in-place orin-file without using space outside of the file. The figure illustratesthe in-place updating of the file 155 in five stages 201-205.

The first stage 201 shows the segmentation of the file 155 according tothe segmentation map 125. As illustrated, the segmentation map 125divides the file 155 into segments 211-218. This segmentation applies tothe file 155 both before the updating process and after the updatingprocess, and the figure at stage 201 illustrates the segment assignmentin both the original version 271 and the new version 272 of the file155. As mentioned, the segmentation map (125) specifies the size of eachsegment in the original file and in the updated file. Based on thesequencing of the segments in the segment map 125 and theircorresponding sizes, the updater is able to identify the position (thestart and the end) of each segment in the original file and in theupdated file.

The segmentation map 125 also specifies the type of each segment.Specifically, the segments 211, 214, 217 are “A” segments to be updatedby archives, the segments 212, 215, and 216 are “P” segments to beupdated by patches, and the segment 213 is a “C” segment to be updatedby copying. The old version of each segment is illustrated without aprime (A1, P2, C3, A4, P5, etc), while the new version of each segmentis illustrated with a prime (A1′, P2′, C3′, A4′, P5′, etc).

The second stage 202 shows the creation of free space within the file155 by vacating archive segments (“A” segments). The data of the archivepayload will expand to replace the original content of these segments,and the file update process does not need the original content of the“A” segments at all. Some embodiments therefore vacate the spacesoccupied by “A” segments (i.e., 211, 214, 217), making them available asfree space for subsequent updating of “P” and “C” segments. At the endof stage 202, only P and C segments remain, as the old versions of thesesegments are needed to construct their corresponding new versions.

The third stage 203 conceptually shows the in-place patching operationsin progress. The in-place patching operation updates the “P” and the “C”segments in sequence, segment by segment. In some embodiments, thein-place patching operations utilize the available free spaces withinthe file to move data around in order create room for the new version ofeach “P” or “C” segment. In some embodiments, the new version of the “P”or “C” segment is constructed at its new position as specified by thesegmentation map. During this construction, as free space in the file isconsumed to store the content of the new version, the content of the oldversion is vacated to open additional free space for subsequent updateoperations. As illustrated, the segment 212 (“P2”) and the segment 213(“C3”) have been updated (illustrated as P2′ and C3′) to theircorresponding new versions at their new positions by the updater. Theupdater is currently updating the segment 215 (“P5”) by patching. Theupdater has moved parts of the segment 216 (“P6”) elsewhere within thefile to make room for the new version of P5 (illustrated as P5′).

To facilitate the movement of data within the target file (155), someembodiments divide the file into a number of pages. To move data withinthe file, the updater in some embodiments moves the pages around thefile to create the necessary room. In order to track the movement ofthese pages, some embodiments employ a number of page-tracking tables250. As illustrated, these page-tracking tables include a “NEW” table,an “OLD” table, a “POS” table, and a “USE” table. The operations ofthese tracking tables during the in-file updating process will befurther described by reference to FIGS. 4-5 below.

The fourth stage 204 shows the state of the file 155 at the completionof the patching operations. At this stage, all of the “C” and “P”segments have been updated, i.e., the patching operations have installedthe new versions of segments 212, 213, 215, 216, and 218 at their newpositions. (For a “C” segments, the in-place patching process installsthe data of the old version at the new position of the segment in someembodiment). The completion of the in-place patching operations has leftseveral slots of free spaces, some of which were used to hold content ofthe original “P” and “C” segment. These open slots correspond to “A”segments 211, 214, and 217, which have yet to be filled with data fromthe archive payload.

The final stage 205 shows the updating of the “A” segments.Specifically, the updater expands the compressed data in the archivepayload 145 to fill the free space in the file 155 that are left for “A”segments 211, 214, and 217. Once the updater has filled space reservedfor “A” segments, the updating of the file 155 is complete.

In the example of FIG. 2, the updated version of the file 155 is smallerthan the original version of the file 155. Consequently, there is extraspace 290 at the end of the updated file, some embodiments then resizethe file 155 and de-allocate the extra space back to the system forother uses.

When the new version the target file is smaller than its old version,the updater in some embodiments assumes that there is already enoughfree space within the file to perform in-place patching. On the otherhand, if the new version is larger than the old version, the updater insome embodiments would resize the target file to its eventual size inorder to provide additional free space for the in-place patchingoperations.

FIG. 3 illustrates the segmented updating process when the new versionof the target file is larger than the old version. The figureillustrates the updating of a file 355 according to a segmentation map(not illustrated) in five stages 301-305.

The first stage 301 shows the segment assignment in both the originalversion 371 and the new version 372 of the file 355. The segmentationmap divides the file into segments 311-318. As mentioned, thesegmentation map specifies the size of each segment in the original fileand in the updated file, and the updater is able to determine theeventual size of the new version 372 file 355 after update. This newversion size is larger than the old version 371, so the updater resizesthe file 355 to its eventual updated size by allocating extra space 390.This resized file is thus the working file for the in-place updatingprocess.

The second stage 302 shows the creation of free space within the file355 by vacating “A” segments. In addition, the extra space 390 added tomatch the eventual size of the updated file is also useable as freespace.

The third stage 303 shows the in-place patching operations in progress.The in-place patching operation updates the “P” and the “C” segments bymoving content of those segments around by utilizing the free space thatavailable within the resized file 355. Some embodiments divide the file355 into pages and use page-tracking tables to move the content of thevarious segments by manipulating the pages.

The fourth stage 304 shows the state of the file 355 at the completionof the patching operations. The patching operations have installed thenew versions of “P” and “C” segments 312, 313, 315, 316, and 318, whileopen slots of free space remain for “A” segments 311, 314, and 317.

The final stage 305 shows the updating of the “A” segments 311, 314, and317 by expansion of compressed data in the archive payload. Once theupdater has filled space reserved for “A” segments, the updating of thefile 355 is complete. The size of the final updated file 355 is the sameas specified by the segmentation map, i.e., the updating process hascompletely occupied/consumed the extra space 390 that was added by theinitial resizing of the file 355.

As mentioned, some embodiments divide the target file into pages andperform in-place patching by moving, vacating, and filling these pages.In some embodiments, each of these pages has 4096 bytes. As mentionedabove by reference to FIG. 2, some embodiments track the status, usage,position and movement of these pages by page-tracking tables/arrays,such as “OLD”, “NEW”, “POS”, and “USE”.

The “OLD” table is for mapping the indices of the pages in the originalversion of the file (e.g., 271) to their current positions in the file(as the file is being updated). In some embodiments, if a page is nolonger in the file (e.g., vacated), the “OLD” table returns ‘Ø’.

The “NEW” table is for mapping the indices of the pages in the eventualnew version of the file (e.g., 272) to their current positions in thefile (as the file is being updated). In some embodiments, if a page isnot yet in the file (e.g., not generated), the “NEW” table returns ‘Ø’.

The “USE” table is for mapping the indices of the pages in the file (asthe file is being updated) to their use. In some embodiments, the usecan be one of ‘Ø’ (not used, or free), “N” (storing content of a newsegment), or “O” (storing content of an old segment).

The “POS” table is for mapping the indices of pages in the file (as thefile is being updated) to their indices in the eventual new version ofthe file or in the old version of the file. In some embodiments, the“POS” table returns ‘Ø’ if it is free.

In some embodiments, the following is always true for the four pagetracking tables: (“i” is index)

If OLD[i] is not Ø then USE[OLD[i]] = O and POS[OLD[i]] = i If NEW[i] isnot Ø then USE[NEW[i]] = N and POS[NEW[i]] = i If USE[i] is O thenOLD[POS[i]] = i If USE[i] is N then NEW[POS[i]] = i

FIGS. 4-5 illustrate page-based in-place/in-file updating operations.The example of FIG. 4-5 is based on the example target file 155 andcorresponds to stages 202 and 203 of FIG. 2. Specifically the FIGS. 4-5illustrate (i) the initial vacating of the “A” segments pages, (ii) themoving of pages to create room for a new segment, (iii) the generatingof new segment pages by locating corresponding old segment pages, and(iv) the vacating of the corresponding old segment pages. FIGS. 4-5illustrate the page-based in-place updating operations in seven stages401-407.

The stage 401 shows the file 155 right after the updater initiallysegmented the file according to the segmentation map and vacated the “A”segments to create free space. As illustrated, the pages of segments P2(212), C3 (213), P5 (215), and P8 (218) are holding data for theiroriginal versions (marked with ‘2’, ‘3’, ‘5’, and ‘8’, respectively),while all other pages (for “A” segments A1, A4, and A7) have beenvacated to be free space (shown as blank).

Some embodiments initialize the page-tracking tables at the start ofin-place updating operation when the updater first receives thesegmentation map from the update package. Some embodiments initializeall the tables to Ø and then retain all the pages indices in segmentsmarked copy or patch

OLD[i]=i, USE[i]=O, POS[i]=i

i.e. all these pages are used and at their initial positions in the oldversion of the file. This effectively vacates the “A” segment whilekeeping the original content “C” and “P” segments.

The second stage 402 shows the preparation for patching the segment P2.As illustrated, the new version of P2 (shown as P2′) spans a number ofpages that are currently occupied by pages 451 that are holding originaldata for segments P2 and C3. Consequently, the updater in someembodiments move these pages to free spaces elsewhere in the file 155 tomake room for the new P2 segment (P2′).

Some embodiments perform the movement of the pages by updating thepage-tracking tables. Specifically some embodiments make room for thenew version segment by doing the following:

for each page ‘i’ of the output segment, if USE[i] is not Ø then find afree page T outside the segment and move the contents of ‘i’ to ‘j’,i.e.,

USE[j] = USE[i], POS[i] = POS[j], OLD[POS[j]] = j. (assuming USE[i] = O)USE[i] = Ø, POS[i] = Ø.

After this step, all pages spanned by the new version of the segment arefree so the updater can perform copy/patch.

The third stage 403 shows the patching operation for the “P” segment P2.The updater 105 performs the patching operation based on the patchingpayload for P2 and the old segment content for P2. As illustrated, theupdater retrieves the patching data for P2 from the update file 115 andlocates the old version of the data for P2 by using the page tables 250.The old version of the data for P2 can be scattered all over the file155 (pages 452 and 453), but the updater can use the page-trackingtables to locate them. The updater then creates the new version data forsegment P2 by patching the old version data with the patch data. Theupdater stores the resulting new version data into pages that werevacated earlier for updated segment P2′. Each of these pages isillustrated as “n2”. Correspondingly, the updater marks the pages of thenew version segment P2 as used: for each page ‘i’ of the updatedsegment,

USE[i]=N and POS[i]=i.

Once the new version data of P2 has been generated and installed at itsintended location, the updater vacates the pages storing P2's oldversion data, as these data are no longer needed by the updating processand can be discarded to make room for subsequent updating operations(patching, copying, or archive expansion). Correspondingly, for eachpage ‘i’ holding the old version segment,

USE[OLD[i]]=Ø, POS[OLD[i]]=Ø, OLD[i]=Ø.

The fourth stage 404 illustrates the vacating of the pages that wereholding the old version data of P2 (pages 452 and 453, shown withslash).

FIG. 5 (stages 405-407) illustrates the in-place patching of the “C”segment C3. The data of a “C” segment is identical in both the originalfile and updated file, except for different location. In someembodiments, the updating of a “C” segment is similar to the updating ofa “P” segment, but without patching differential data. Specifically, toupdate a segment by copying, the updater has to make room for thesegment at its new location before moving its old version data into itsnew location. Some embodiments of the updater therefore handles “C”segment as it does “P” segments, except without retrieving anydifferential data from the patching payload.

The fifth stage 405 shows the preparation for copying the segment C3. Asillustrated in FIG. 4, the new version of C3 (shown as C3′) spans anumber of pages 456 that are either free or currently occupied by pagesthat are holding original data of C3. However, the new version of thesegment C3 is not located at the exact same location as the old versionof the segment C3, so the pages holding the old version data of C3 hasto be moved in order to make room for the updated C3′ (though the datais identical). Consequently, the updater moves these pages and trackstheir movement by using the page-tracking tables 250.

The sixth stage 406 shows the copying operation of the “C” segment C3.The updater 105 performs the patching operation based on the old segmentcontent for C3. As illustrated, the updater locates the old version ofthe data for C3 by using the page tables 250. The old version of thedata for C3 can be scattered all over the file 155 (in pages 457), butthey can be located by using the page-tracking tables. The updater thencopies the old version data from their original location (pages 457)into their new locations (pages 458). Each of these pages in the newlocation is illustrated as “n3”. Correspondingly, the updater marks thepages of the new version segment C3 as used (USE[i]=N and POS[i]=i foreach page ‘i’ of the updated segment.)

Once the data of C3 has been copied to its intended new location, theupdater vacates the pages storing C3's old version data, as these dataare no longer needed by the updating process and can be discarded tomake room for subsequent patching/copying operations. The seventh stage407 illustrates the vacating of the pages that were holding the oldversion data of C3 (pages 457, shown with slash) and make them into freespaces

For some embodiments, FIG. 6 conceptually illustrates a process 600 forperforming in-place update of a file, i.e., by using only the spacealready allocated to the target file. In some embodiments, a computingdevice (e.g., 100) receiving an update package and performing fileupdate performs the process 600. The process will be described byreferencing the example of FIGS. 1-5.

The process starts when it receives (at 610) an update package ordownload that includes the update file for a particular file (e.g., theupdate file 115 “file n update” for the file 155 “file n”). In someembodiments, such a file is a very large library file such as a DYLDshared cache. The process then identifies (at 620) the segmentationsdefined by the update package. As illustrated in FIG. 1, the updatepackage in some embodiments include a segmentation map (125), whichdefines the location/position, the type (“C”, “P”, or “A”), and thesizes of each segment in the original version of the file (271) and inthe new version of the file (272).

The process then determines (at 630) whether the size of the originalfile is larger or size of the eventual updated file is larger. Theeventual size of updated file can be determined from the segmentationmap, which specifies the size of each segment in the original file aswell as in the updated file. If the original version of the file islarger than the new version of the file, some embodiments assume thereis going to be enough free space within the file and the processproceeds to 640. If the eventual size of the updated file is larger, theprocess proceeds to 635. The determination of whether to add this extrafree space is described by reference to FIG. 3 above.

At 635, the process allocates (at 635) additional space to the fileaccording to its eventual size. The additional space will be used asfree space for subsequent in-file updating/patching operations. Theprocess then proceeds to 640.

At 640, the process identifies segments that are to be updated byarchive (“A” segments) and vacate them as free space. As mentioned, theold version data of these segments are not needed for determining thenew version data of these segments, so some embodiments vacate them asfree space for subsequent in-place updating/patching operations.

The process then uses (at 650) the free space made available earlier toperform patching or copying operations for each “P” or “C” segmentsin-file. The in-file patching/copying operation will be furtherdescribed in detail by reference to FIG. 7 below. Some embodimentsdivide the target file into pages, and some of these embodiments performthe operations 640 and 650 by using page-tracking tables as described byreference to FIGS. 4 and 5 above.

Once each of the “P” and “C” segments have been patched and copied, theprocess expands (at 660) the compressed new version data in the archivepayload of the update package for each “A” segment. Once the expandeddata have been stored in their respective new segment locations, theprocess 600 ends.

FIG. 7 conceptually illustrates a process 700 for performing patch/copyoperations for “P” and “C” segments. In some embodiments, the computingdevice performs the process 700 when it performs the operation 650 ofFIG. 6 after the process 600 has already vacated the “A” segments.

The process 700 starts when it identifies (at 710) a “C” or “P” segment.The process then makes (at 720) room for the identified segment at itsnew location in the file by moving content that falls within that newlocation to the available free space within the file.

Next, the process locates (at 730) the original content of theidentified “C” or “P” segment stored elsewhere in the file. Such contentare often scattered all over the file when the process creates room forupdated segments. Some embodiments use page-tracking tables to locatethe original content as described above by reference to FIGS. 4 and 5.

The process then determines (at 740) whether the segment is a “C”segment to be updated by copying or a “P” segment to be updated bypatching. If the segment is a “C” segment, the process proceeds to 750.If the segment is a “P” segment, the process proceeds to 745.

At 745, the process applies the patch (e.g., differential data) storedin the patch payload of the update package to the original content ofthe “P” segment located elsewhere in the file. The patching operationcreates patched content of the segment, and the process installs thepatched content to the segment's new location (that was just vacated inoperation 720). The process then proceeds to 755.

At 750, the process copies the original content of the “C” segmentlocated elsewhere in the file to the segment's new location. Asmentioned, this operation is similar to the patching of “P” segment,except no patching differential data is applied. The process thenproceeds to 755.

At 755, the process vacates the original content of the segment as it isno longer needed. The free space is available for use by subsequentin-place patching or copying operations. Some of these free space wouldeventually be used for storing data of updated “A” segments. The processthen determines (at 760) if there is another “P” or “C” segments to beupdated. If so, the process proceeds to 710. Otherwise the process 700ends.

II. Generating Segmented Update Package

Some embodiments invention also provides a method for generating anupdate package that segments the updating of a file. In someembodiments, the method divides the file to be updated into segments,compares old and new versions of each segment and determines whether thesegment should be updated by copying, patching, archiving.

FIG. 8 illustrates an update package generating system 800 forgenerating an update package using segmented updating. In someembodiments, such an update package generation system 800 operates in aserver device that provides software update to client devices (e.g.,100).

As illustrated, the system 800 (or update package generator) isgenerating the update package 110 for updating for a set of files basedon a set of original files 811 and a set of corresponding updated files812. One of the files being updated is the file 155 (file n). For thefile 155, the update package 110 includes the update file 115, whichincludes the segmentation map 125, the patch payload 135, and thearchive payload 145.

The figure also illustrates the generation of the update file 115 fromthe old and new versions (file n and file n′) of the file 155 by thesystem 800. As illustrated, the update package generation system 800includes a segmentor 820, a comparator 830, a patch generator 840, andan archive generator 850. These components produce the segmentation map125, the patch payload 135, and the archive payload 145 for the updatefile 115.

The segmentor 820 receives the old and new versions (file n and file n′)of the file 155 and determines a segmentation scheme 825, i.e., thelocations and sizes of each segment in the old version of the file aswell as in the new version of the file. In some embodiments, thesegmentor 820 produces progressively larger segments by e.g., followinggeometric progression.

The comparator 830 uses the segmentation scheme 825 and selects anupdating method (copy, patch, or archive) for updating each segment.Some embodiments make this selection for each segment by comparing theold and new versions of the segment and selecting an updating methodthat results in smallest size for the update file. The comparator thenproduces the segmentation map 125 and designates the updatingmethod/type of each segment (along with each segment's size and positionin the original file and updated file.)

The patch generator 840 uses the segment map 125 to identify thesegments that are to be updated by patching (“P” segments). For each ofthese segments, the patch generator generates its patch payload by e.g.,computing the differential data between the old and new versions of thesegment.

The archive generator 850 uses the segmentation map 125 to identify thesegments that are to be updated by archiving (“A” segments). For each ofthese segments, the archive generator 850 compresses the content of thenew version of the segment and store the compressed data as archivepayload 145.

FIG. 9 conceptually illustrates a process 900 for generating an updatefile using segmented updating. In some embodiments, the update packagegenerator 800 performs the process 900 when generating the segment map125, the patch payload 135, and the archive payload 145.

The process 900 starts when it receives (at 910) a new version and anold version of a file. In some embodiments, the file is a very largelibrary file (such as DYLD shared caches) for an operating system updatepackage. The process then divides (at 920) the file into segments. Insome embodiments, the process defines segments to be of progressivelylarger size such that the later segments are larger than earliersegments.

The process then identifies (at 930) a segment and its correspondingdata from the new version of the file and from the old version of thefile. The process then determines if the new version of the segment isidentical to the old version of the segment. If so, the processdesignates (at 945) the segment as a segment to be updated by copy (“C”segment”) and proceeds to 990. Otherwise, the process proceeds to 950.

At 950, the process performs binary diff between the old and newversions of the segment. The process also performs (at 960) compressionof the new version of the segment. The process then determines (970)whether the binary diff between old and new is smaller, or whether thecompression of the new is smaller. If the binary diff between the oldand new is smaller, the process designates (at 975) the segment as a “P”segment to be updated by patching and produces the corresponding patchpayload based on the binary diff. If the compression of the new issmaller, the process designates (at 980) the segment as an “A” segmentto be updated by archive and produces the corresponding archive payloadbased on the compressed new version segment. Once the process hasdesignated the segment as a “P”, “A”, or “C” segment, it proceeds to990.

At 990, the process determines if there is another segment for which theprocess has yet to identify an updating method. If so, the processreturns to 930. Otherwise the process generates (at 995) thesegmentation map that specifies each segment's information (size,location, updating method). The process also creates the update filefrom the generated segmentation map, the patch payload, and the archivepayload. The process 900 then ends.

In addition to generating the segmentation map, the patch and archivepayload, the update package generator in some embodiments also checkswhether segmentation truly allows the update of the file to be performedin-place, i.e., would there be enough free space within the file duringupdate process. To do this check, the update package generator in someembodiments emulates the behavior of the computing device (e.g., 100)that receives the update package and performs the in-place updating tosee if there would be enough free space within the file.

In the in-file/in-place updating examples illustrated and discussed inSection I above, the computing device performing in-place updating haveenough free space within the file because the segmentation map hasidentified enough “A” segments for the updater to vacate and providesufficient free space. However, it is possible that the update packagegenerator may initially produce a segmentation map that does not providesufficient free space by failing to identify sufficient number of “A”segments (since the initial goal of the update package generation is toproduce the smallest update file rather than making the update filelarger just to have enough free space). Consequently, in someembodiments, if the update package generator determines that the filewould not have enough free space to complete updating in-place, it wouldchange the update type/method of some of the segments from patch/copy toarchive.

FIG. 10 illustrates the update package generator checking for sufficientfree space for in-file updating. As illustrated, the update generator800 further includes an in-place emulator 1010 and a segment converter1020. The in-place emulator 1010 is for emulating the in-placepatching/updating operations that will be performed according to theupdate package. In other words, the emulator 1010 emulates the behaviorof the updater 105 as described in Section I above. In this example, theemulator 1010 emulates in-place updating based on a proposed update file1005 and a segmentation map 1025 included therein. The segmentation map1025 has defined update segments 1031-1038. The update file 1005 is“proposed” because it has not been verified to have sufficient freespace.

As illustrated, the emulator 1010 has emulated the in-place updatingoperations according to the update file 1005 and determined that thein-place updating needs at least 40K bytes of additional free spacein-file. In order to provide the requisite amount of additional freespace, the segment converter 1020 goes through the segment map 1025 tolook for “P” or “C” segment to turn into an “A” segment.

To keep the oversize of the update package as small as possible, thesegment converter 1020 in some embodiments looks for the smallest “P” or“C” segment that is large enough to provide the sufficient free space.As mentioned, in some embodiments, a segmentation map arranges thesegments according to their sizes, and the sizes of the segments in themap follows a geometric progression. Consequently, the segment converter1020 can follow the progression of segment sizes and stop at the first“P” or “C” segment that is large enough to provide the requisite freespace.

In the example of FIG. 10, the segment map 1025 shows the segment sizesof the segments 1031-1038 follow a geometric progression: 10K, 15K, 23K,34K, 51K, 80K, 114K, and 171K, etc. (geometric factor of 1.5). Since theemulator 1010 has determined that 40 KB of additional free space isneeded, the converter 1020 stops at the “P” segment 1035 with size 51K.In some embodiments, this series of increasing segment sizes are thesizes of the original segments, because the original sizes of thesegments determine how much additional free space would be madeavailable by the vacating of the “A” segments.

Once the suitable “P” segment 1035 has been identified, the segmentconverter 1020 makes the segment 1035 into an A segment. In someembodiments, the segment converter 1020 makes this change by modifyingthe segment map 825 (to change the update method of the segment 1035 toarchive) and by generating and including the archive payload for thesegment 1035. The update package generator then creates a modifiedupdate file 1015 based on the newly modified segment and stores it inthe update package 110.

In some embodiments, the geometric progression of the segment sizes doesnot apply to all segments of the file being updated. In someembodiments, some sections of the file contain segments that correspondto specific library parts (such as DYLIBs) which have specific sizes,and the update file generation process of some embodiments does notalter them to be part of the geometric progression. In some embodiments,only portions of the file that contains specific data types (such asconstants or tables) are divided into segments with sizes accordinggeometric progression but not others.

FIG. 11 conceptually illustrates a process 1100 for ensuring that anupdate file or segmentation scheme would have sufficient free space toperform in-place update/patching. The update package generator 800 insome embodiments performs this process (e.g., at its in-place emulator1010 and its segment converter 1020).

The process 1100 starts when it receives (at 1110) a proposed updatefile. The process then emulates (at 1120) in-place patching/updatingaccording to the update file and the segmentation map included therein.Based on the emulation, the process determines (1130) whether the filecan be updated in-place, i.e., whether the in-place updating operationwould have enough free space within the file to operate. If theemulation predicts that there will be enough space in-file, the processproceeds to 1180. If the emulation indicates that there won't besufficient free-space in-file, the process proceeds to 1140.

At 1140, the process identifies or determines how much more additionalfree space is needed. Some embodiments make this determination byidentifying the “P” or “C” segment for which the in-place updatingemulation failed. The process then identifies (at 1150) the smallestpatching or copying segment that is large enough to provide the requiredspace for in-place patching. Some embodiments follow the geometricprogression of segment sizes to find the smallest “P” or “C” segmentthat is large enough. In some embodiments, the system does not determinehow much additional free-space is needed but instead always convert thesmallest “P” or “C” segment to an “A” segment.

Next, the process changes (at 1160) the identified “P” or “C” segmentinto an “A” segment and modifies the segmentation map accordingly. Theprocess then emulates (at 1170) the in-place updating/patching accordingto the modified segmentation map and returns to 1130 to determine if theupdating can be performed in-place.

At 1180, the process finalizes the segmentation map, the archivepayload, and the patch payload for the update package. Specifically, theprocess discards the patching data (differential between old and new)for the converted segments (“P” or “C” segments that have been convertedto “A” segments) and replaces the patching data with the correspondingarchive data (compressed new version). The process 1100 then ends.

III. Multi-Pass Archive Expansion

Sections I and II describe the segmenting of a file in order to performupdate of the file in-place, where the information needed for the updateis from a update package. In some embodiments, such an update package isfor updating a bundle of files, e.g., for updating an entire operatingsystem. Such an update package can be very large, requiring a lot ofstorage space to download and store thus leaving very little free spaceon the disk to perform the actual update (e.g., storing old and newversions for patching operations, storing expanded archive data, etc.)

Some embodiments minimize the free space requirement on disk bysegmenting the update of the entire package and perform the update inmultiple passes. Specifically, some embodiments divide the archivepayload of the entire update package into pieces and expand one piece ofthe archive in each pass. At the end of each pass, some embodimentsremove from the disk the archive piece expanded in that pass in order tofree additional space for the next pass.

In some embodiments, the update package is for updating the operatingsystem or an entire disk of a computing device. Such update packageincludes updates for the system partition but is stored in the userpartition of the disk. In some embodiments, the update package includesupdates for both the system partition and the user partition. The updateoperation in each pass resizes the system partition in order to storesystem partition data expanded from the corresponding archive piece ofthat pass. Some embodiments resize the system partition gradually overthe multiple passes rather than all at once in order to leave as much asspace as possible for user partition during each pass. (The resizingtakes space away from the user partition and gives it to the systempartition so each resizing grows the system partition while shrinkingthe user partition by the same amount.)

For some embodiments, FIG. 12 illustrates an update package 1200 forupdating a disk image/operating system on a computing device 1290(illustrated as a mobile device). The update package 1200 includesarchive data 1210 that are partitioned into multiple archive pieces1211-1219 to be expanded in multiple updating passes. The update packagealso includes data for patches (patch payload) 1220, as well as a listof files to be removed (remove list 1231), a list of files to be updatedby patching (patch list 1232), a list of files to be updated by archive(archive list 1233). The computing device 1290 is executing an updaterprogram or module 1205 for performing the update process based on theupdate package 1200.

The computing device 1290 has a storage 1260 that is organized accordingto a disk image 1280. The disk image 1280 of the storage 1260 ispartitioned into a systems partition 1281, a user partition 1282, andboot partition 1283. The systems partition 1281 stores systems data 1271for the operating system of the computing device 1290. It normally bootsup to be a read-only partition whose data cannot be altered by useroperations. The boot partition 1283 stores boot loader data 1273 that isused for booting the operating system. The user partition 1282 storesuser data 1272 and is readable/writeable by user operations. It is alsoused to store the downloaded update package 1200. As illustrated, theupdate package 1200 occupies a significant portion of the user partition1282 and leaves very little free space in the storage 1280.

Before expanding any of the archive pieces, some embodiments perform aseries of operations to free up additional space in the disk. Theseoperations includes removing files that are in the list of files toremove, removing files that will be replaced by expanded archives, andperform patching and removing patch payload. FIG. 13 illustrates theoperations to free additional disk space before expanding archivepieces. The figure illustrates the disk space freeing operation in fourstages 1301-1304. The hashed portion indicates free space.

The first stage 1301 shows the system partition 1281 and the userpartition 1282 right after the download of the update package 1200. Theupdate package has all of its components stored in the user partition(i.e., archive pieces 1210, patch payload 1220, lists of files toremove/patch/archive 1231-1233). The system data 1271 and the user data1272 are as they were before the download of the update package. Thesystem partition is read-only and cannot be altered. In someembodiments, in order to update the system partition, the computingdevice has to reboot on a different set of boot data and make the systempartition writeable. Some embodiments therefore stores alternative bootdata into the storage 1260 and initiates reboot to make the systempartition writeable. The second stage 1302 shows the disk image 1280after the reboot operation that makes the system data writeable.

The third stage 1303 shows the updater 1205 using the remove list 1231and the archive list 1232 to identify and remove the files that can beremoved. The files in the remove list are files that are not to be partof the disk image 1280 after update. The files in the archive list arefiles that will entirely replaced by data in the archives later. Some ofthe files removed are files in the system partition, which is nowwriteable. The figure illustrates some of the files removed are in theuser partition, though some embodiments only remove files from thesystem partition in some embodiments. The removal of these files freesup disk space that will be used to store expanded data from the archivepieces 1211-1219.

The fourth stage 1304 shows the updater 1205 using the patch list 1233to identify files to be patched and using the patch payload 1220 topatch the identified files. The files being patched may increase ordecrease in size. In some embodiments, some of these files are largelibrary files (e.g., 32-bit DYLD and 64-bit DYLD) that are updated byusing in-place updating described in Section I. After the files in thepatch list have been patched, the updater 1205 removes the used patchpayload 1220 from the stored update package 1200, thus freeing even moredisk space. The figure shows the files being updated includes files inboth the system partition and files in the user partition, though someembodiments update only files in the system partition.

After the initial freeing of disk space according to the remove list,archive list, and the patch list, the updater 1205 in some embodimentsproceed to expand the archive pieces 1211-1219. FIG. 14 illustrates theexpansion of archive pieces in multiple updating passes. The figureillustrates the archive expansion operations in five stages 1401-1405.

The first stage 1401 shows the disk image 1280 of the storage 1260 afterthe initial space-freeing operations described by reference to FIG. 13above. As illustrated, the disk image 1280 of the storage 1260 hasspaces that are freed from the removed files and the removed used patchpayload. There are free spaces in the system partition 1281 as well asin the user partition 1282. The first stage also shows the archivepieces 1211-1214 (illustrated as A1-A4) stored in the storage 1260 asparts of the update package are still in the device. Archive pieces1215-1219 are not illustrated for simplicity.

The second stage 1402 shows the first pass of the archive expansionoperation. As illustrated, the updater accesses the archive piece 1211(A1) and expands its content into the system partition 1281. The stagealso shows the resizing of system partition 1281. The resizing takesaway free space from the user partition and give it to the systempartition in order to make room for system data that are expanded fromthe archive piece 1211 in this first pass of updating. After completingexpansion of the archive 1211, the updater 1205 removes the archivepiece 1211 to free more space in the storage 1260 for the subsequentarchive expansion passes.

The third stage 1403 shows the second pass of the archive expansionoperation. As illustrated, the updater 1205 has removed the archivepiece 1211. The updater 1205 accesses the archive piece 1212 (A2) andexpands its content into the system partition 1281 and the userpartition 1282. The system partition 1281 is resized again order to makeroom for system data that are expanded from the archive piece 1212 inthis second pass of updating. After completing expansion of the archive1212, the updater 1205 removes the archive piece 1212 to free more spacein the storage 1260 for the subsequent archive expansion passes.

The fourth and fifth stages 1404 and 1405 show the subsequent passes(third and fourth passes) of the archive expansion operation. Theupdater 1205 in each pass (i) resizes the system partition to acceptmore system data from the archives, (ii) expands an archive piece andstores the expanded content into free space in system and/or userpartition, and (iii) removes the used archive piece. The updating passescontinues until all archive pieces have been expanded and removed fromthe storage 1260. The updater 1205 then makes the system portion readonly through another reboot and completes the updating process.

FIG. 14 shows expansion of archive pieces into both the system partition1281 and the user partition 1282. However, in some embodiments, thearchive expansion is only for files in the system partition but notfiles in the user partition. Consequently, in some of those embodiments,the archive expansion process would not alter the content of the userpartition.

FIG. 15 illustrates the total disk usage throughout the multi-passarchive expansion process. As illustrated, the disk usage increasessignificantly following the download of the update package, but thenreduces significantly following the removal of the files according tothe remove list and the archive list. The total usage increases afterpatches are applied, and then reduces after the patch payloads areremoved. The total usage of the disk then increases following theexpansion of the archive piece and reduces following the removal of thearchive pieces. The increase-decrease cycle of total disk usagecontinues through each pass of the multi-pass archive expansions processuntil the last archive is expanded and removed.

For some embodiments, FIG. 16 conceptually illustrates a process 1600for performing multi-pass archive expansion operations. Some embodimentsperform this process at a computing device that receives an updatepackage that divides the archive payload into multiple archive pieces.

The process starts when it receives (at 1610) and stores an updatepackage in its storage. The update package includes the a list of filesto remove, a list of files to update by patch, a list of files to updateby archive, a patch payload, and an archive payload that is divided intoseveral archive pieces. In some embodiments, the package is for updatingthe entire disk image of the computing device or the operating systemrunning on the computing device. The process then reboots (at 1620) tomake the system partition of the storage writeable so the process canremove, add, or modify files in the system partition.

Next, the process removes (at 1630) files from the storage according tothe list of files to remove and removes (at 1640) files from the storageaccording to the list of files to be updated by archive expansion. Theprocess then applies (at 1650) patches provided by the update packageand then removes (at 1660) the patch data from the storage.

The process then starts the multi-pass expansion of the archive pieces.The process identifies (1670) an archive piece in the update package forexpansion in the current pass. The process then resizes (at 1675) thesystem partition to accommodate data that are to be expanded from theidentified archive piece. The process then expands (at 1680) theidentified archive piece into the user partition as well into theresized system partition. The process then removes (at 1690) the archivepiece since the data therein has already been expanded and stored.

The process then determines (at 1695) whether there are another archivepieces to expand. If so, the process returns to 1670 for another pass ofthe multi-pass archive expansion process. Otherwise the process 1600ends.

IV. Electronic System

Many of the above-described features and applications are implemented assoftware processes that are specified as a set of instructions recordedon a computer readable storage medium (also referred to as computerreadable medium). When these instructions are executed by one or morecomputational or processing unit(s) (e.g., one or more processors, coresof processors, or other processing units), they cause the processingunit(s) to perform the actions indicated in the instructions. Examplesof computer readable media include, but are not limited to, CD-ROMs,flash drives, random access memory (RAM) chips, hard drives, erasableprogrammable read only memories (EPROMs), electrically erasableprogrammable read-only memories (EEPROMs), etc. The computer readablemedia does not include carrier waves and electronic signals passingwirelessly or over wired connections.

In this specification, the term “software” is meant to include firmwareresiding in read-only memory or applications stored in magnetic storagewhich can be read into memory for processing by a processor. Also, insome embodiments, multiple software inventions can be implemented assub-parts of a larger program while remaining distinct softwareinventions. In some embodiments, multiple software inventions can alsobe implemented as separate programs. Finally, any combination ofseparate programs that together implement a software invention describedhere is within the scope of the invention. In some embodiments, thesoftware programs, when installed to operate on one or more electronicsystems, define one or more specific machine implementations thatexecute and perform the operations of the software programs.

FIG. 17 conceptually illustrates an electronic system 1700 with whichsome embodiments of the invention are implemented. The electronic system1700 may be a computer (e.g., a desktop computer, personal computer,tablet computer, etc.), phone, PDA, or any other sort of electronicdevice. Such an electronic system includes various types of computerreadable media and interfaces for various other types of computerreadable media. Electronic system 1700 includes a bus 1705, processingunit(s) 1710, a graphics processing unit (GPU) 1715, a system memory1720, a network 1725, a read-only memory 1730, a permanent storagedevice 1735, input devices 1740, and output devices 1745.

The bus 1705 collectively represents all system, peripheral, and chipsetbuses that communicatively connect the numerous internal devices of theelectronic system 1700. For instance, the bus 1705 communicativelyconnects the processing unit(s) 1710 with the read-only memory 1730, theGPU 1715, the system memory 1720, and the permanent storage device 1735.

From these various memory units, the processing unit(s) 1710 retrievesinstructions to execute and data to process in order to execute theprocesses of the invention. The processing unit(s) may be a singleprocessor or a multi-core processor in different embodiments. Someinstructions are passed to and executed by the GPU 1715. The GPU 1715can offload various computations or complement the image processingprovided by the processing unit(s) 1710.

The read-only-memory (ROM) 1730 stores static data and instructions thatare needed by the processing unit(s) 1710 and other modules of theelectronic system. The permanent storage device 1735, on the other hand,is a read-and-write memory device. This device is a non-volatile memoryunit that stores instructions and data even when the electronic system1700 is off. Some embodiments of the invention use a mass-storage device(such as a magnetic or optical disk and its corresponding disk drive) asthe permanent storage device 1735.

Other embodiments use a removable storage device (such as a floppy disk,flash memory device, etc., and its corresponding disk drive) as thepermanent storage device. Like the permanent storage device 1735, thesystem memory 1720 is a read-and-write memory device. However, unlikestorage device 1735, the system memory 1720 is a volatile read-and-writememory, such a random access memory. The system memory 1720 stores someof the instructions and data that the processor needs at runtime. Insome embodiments, the invention's processes are stored in the systemmemory 1720, the permanent storage device 1735, and/or the read-onlymemory 1730. For example, the various memory units include instructionsfor processing multimedia clips in accordance with some embodiments.From these various memory units, the processing unit(s) 1710 retrievesinstructions to execute and data to process in order to execute theprocesses of some embodiments.

The bus 1705 also connects to the input and output devices 1740 and1745. The input devices 1740 enable the user to communicate informationand select commands to the electronic system. The input devices 1740include alphanumeric keyboards and pointing devices (also called “cursorcontrol devices”), cameras (e.g., webcams), microphones or similardevices for receiving voice commands, etc. The output devices 1745display images generated by the electronic system or otherwise outputdata. The output devices 1745 include printers and display devices, suchas cathode ray tubes (CRT) or liquid crystal displays (LCD), as well asspeakers or similar audio output devices. Some embodiments includedevices such as a touchscreen that function as both input and outputdevices.

Finally, as shown in FIG. 17, bus 1705 also couples electronic system1700 to a network 1725 through a network adapter (not shown). In thismanner, the computer can be a part of a network of computers (such as alocal area network (“LAN”), a wide area network (“WAN”), or an Intranet,or a network of networks, such as the Internet. Any or all components ofelectronic system 1700 may be used in conjunction with the invention.

Some embodiments include electronic components, such as microprocessors,storage and memory that store computer program instructions in amachine-readable or computer-readable medium (alternatively referred toas computer-readable storage media, machine-readable media, ormachine-readable storage media). Some examples of such computer-readablemedia include RAM, ROM, read-only compact discs (CD-ROM), recordablecompact discs (CD-R), rewritable compact discs (CD-RW), read-onlydigital versatile discs (e.g., DVD-ROM, dual-layer DVD-ROM), a varietyof recordable/rewritable DVDs (e.g., DVD-RAM, DVD-RW, DVD+RW, etc.),flash memory (e.g., SD cards, mini-SD cards, micro-SD cards, etc.),magnetic and/or solid state hard drives, read-only and recordableBlu-Ray® discs, ultra density optical discs, any other optical ormagnetic media, and floppy disks. The computer-readable media may storea computer program that is executable by at least one processing unitand includes sets of instructions for performing various operations.Examples of computer programs or computer code include machine code,such as is produced by a compiler, and files including higher-level codethat are executed by a computer, an electronic component, or amicroprocessor using an interpreter.

While the above discussion primarily refers to microprocessor ormulti-core processors that execute software, some embodiments areperformed by one or more integrated circuits, such as applicationspecific integrated circuits (ASICs) or field programmable gate arrays(FPGAs). In some embodiments, such integrated circuits executeinstructions that are stored on the circuit itself. In addition, someembodiments execute software stored in programmable logic devices(PLDs), ROM, or RAM devices.

As used in this specification and any claims of this application, theterms “computer”, “server”, “processor”, and “memory” all refer toelectronic or other technological devices. These terms exclude people orgroups of people. For the purposes of the specification, the termsdisplay or displaying means displaying on an electronic device. As usedin this specification and any claims of this application, the terms“computer readable medium,” “computer readable media,” and “machinereadable medium” are entirely restricted to tangible, physical objectsthat store information in a form that is readable by a computer. Theseterms exclude any wireless signals, wired download signals, and anyother ephemeral signals.

While the invention has been described with reference to numerousspecific details, one of ordinary skill in the art will recognize thatthe invention can be embodied in other specific forms without departingfrom the spirit of the invention. In addition, a number of the figures(including FIGS. 6, 7, 9, 11, and 16) conceptually illustrate processes.The specific operations of these processes may not be performed in theexact order shown and described. The specific operations may not beperformed in one continuous series of operations, and different specificoperations may be performed in different embodiments. Furthermore, theprocess could be implemented using several sub-processes, or as part ofa larger macro process. Thus, one of ordinary skill in the art wouldunderstand that the invention is not to be limited by the foregoingillustrative details, but rather is to be defined by the appendedclaims.

1. A method of updating files stored in a data storage of a device, themethod comprising: receiving an update package for updating a filestored in the data storage of the device, the file comprising aplurality of segments, each segment requiring update by one of copyingand archiving, segments updated by archiving having their contentreplaced entirely by compressed data from the update package, segmentsupdated by copying having their content updated based on a pre-updatecontent of the segment; removing the segments requiring update byarchiving from the file to open free space inside the file; utilizingthe free space inside the file, moving the segments requiring update bycopying from a first location to a second location inside the file; andfor each segment requiring update by archiving, expanding acorresponding segment in the update package and storing the expandeddata into the free space inside the file.
 2. The method of claim 1,wherein the update package is for updating an operating system of thedevice.
 3. The method of claim 1, wherein the update package furthercomprises a list of files to be updated by patching and a set ofpatching data for said patching, wherein the method further comprisesperforming said patching and removing said patching data in order toprovide additional storage space for expanding the archive pieces. 4.The method of claim 1, wherein the data storage comprises a systempartition and a user data partition.
 5. The method of claim 4 furthercomprising for each of the plurality of archive pieces: resizing thesystem partition; and expanding the archive piece by storing systempartition data from the archive into the resized system partition. 6.The method of claim 1, wherein the package further comprises a list offiles to remove, wherein the method further comprises removing filesidentified by the list of files to remove in order to create free spacein the data storage.
 7. The method of claim 1, wherein the packagefurther comprises a list of files to be replaced by new versions of thefiles stored in the archive, wherein the method further comprisesremoving files identified by the list of files to be replaced in orderto create free space in the data storage.
 8. A computing devicecomprising: a data storage; a set of processing units; and a machinereadable medium storing a program for execution by at least one of theprocessors, the program for updating files stored in the data storage,the program comprising sets of instructions for: receiving an updatepackage for updating a file stored in the data storage, the filecomprising a plurality of segments, each segment requiring update by oneof copying and archiving, segments updated by archiving having theircontent replaced entirely by compressed data from the update package,segments updated by copying having their content updated based on apre-update content of the segment; removing the segments requiringupdate by archiving from the file to open free space inside the file;utilizing the free space inside the file, moving the segments requiringupdate by copying from a first location to a second location inside thefile; and for each segment requiring update by archiving, expanding acorresponding segment in the update package and storing the expandeddata into the free space inside the file.
 9. The computing device ofclaim 8, wherein the update package is for updating an operating systemof the device.
 10. The computing device of claim 8, wherein the updatepackage further comprises a list of files to be updated by patching anda set of patching data for said patching, wherein the program furthercomprises a set of instructions for performing said patching andremoving said patching data in order to provide additional storage spacefor expanding the archive pieces.
 11. The computing device of claim 8,wherein the data storage comprises a system partition and a user datapartition.
 12. The computing device of claim 11, wherein the programfurther comprising a set of instructions for: for each of the pluralityof archive pieces: resizing the system partition; and expanding thearchive piece by storing system partition data from the archive into theresized system partition.
 13. The computing device of claim 8, whereinthe package further comprises a list of files to remove, wherein theprogram further comprises a set of instructions for removing filesidentified by the list of files to remove in order to create free spacein the data storage.
 14. The computing device of claim 8, wherein thepackage further comprises a list of files to be replaced by new versionsof the files stored in the archive, wherein the program furthercomprises a set of instructions for removing files identified by thelist of files to be replaced in order to create free space in the datastorage.
 15. A non-transitory computer readable medium storing a programfor updating files stored on a data storage of a device, the programexecutable by a processing unit, the program comprising sets ofinstructions for: receiving an update package for updating a file storedin the data storage of the device, the file comprising a plurality ofsegments, each segment requiring update by one of copying and archiving,segments updated by archiving having their content replaced entirely bycompressed data from the update package, segments updated by copyinghaving their content updated based on a pre-update content of thesegment; removing the segments requiring update by archiving from thefile to open free space inside the file; utilizing the free space insidethe file, moving the segments requiring update by copying from a firstlocation to a second location inside the file; and for each segmentrequiring update by archiving, expanding a corresponding segment in theupdate package and storing the expanded data into the free space insidethe file.
 16. The non-transitory computer readable medium of claim 15,wherein the update package is for updating an operating system of theclient device.
 17. The non-transitory computer readable medium of claim15, wherein the update package further comprises a list of files to beupdated by patching and a set of patching data for said patching, theprogram further comprising a set of instructions for removing saidpatching data after said patching to provide additional storage spacefor expanding the archive pieces.
 18. The non-transitory computerreadable medium of claim 15, wherein the data storage comprises a systempartition and a user data partition.
 19. The non-transitory computerreadable medium of claim 18, wherein each archive piece comprise data tobe expanded into the system partition in a pass, the program furthercomprising resizing the system partition and expanding the archive pieceby storing system partition data from the archive into the resizedsystem partition.